Optimal Distortion-Power Tradeoffs in Gaussian 

Sensor Networks 



Nan Liu Sennur Ulukus 
Department of Electrical and Computer Engineering 
University of Maryland, College Park, MD 20742 
nkancy® umd. edu ulukus® umd. edu 



Abstract — We investigate the optimal performance of dense 
sensor networks by studying the joint source-channel coding 
problem. The overall goal of the sensor network is to take 
measurements from an underlying random process, code and 
transmit those measurement samples to a collector node in a 
cooperative multiple access channel with imperfect feedback, and 
reconstruct the entire random process at the collector node. We 
provide lower and upper bounds for the minimum achievable 
expected distortion when the underlying random process is 
Gaussian. In the case where the random process satisfies some 
general conditions, we evaluate the lower and upper bounds 
explicitly and show that they are of the same order for a 
wide range of sum power constraints. Thus, for these random 
processes, under these sum power constraints, we determine 
the achievability scheme that is order-optimal, and express the 
minimum achievable expected distortion as a function of the sum 
power constraint. 

I. Introduction 

With the recent advances in the hardware technology, small 
cheap nodes with sensing, computing and communication 
capabilities have become available. In practical applications, 
it is possible to deploy a large number of these nodes to sense 
the environment. In this paper, we investigate the optimal 
performance of a dense sensor network by studying the 
joint source-channel coding problem. The sensor network is 
composed of N sensors, where N is very large, and a single 
collector node. The overall goal of the sensor network is to 
take measurements from an underlying random process S(t), 
< t < To, code and transmit those measured samples to a 
collector node in a cooperative multiple access channel with 
imperfect feedback, and reconstruct the entire random process 
at the collector node. We investigate the minimum achiev- 
able expected distortion and the corresponding achievability 
scheme when the underlying random process is Gaussian and 
the communication channel is a cooperative Gaussian multiple 
access channel with feedback (potentially imperfect). 

Scaglione and Servetto [1] investigated the scalability of 
the sensor networks. The goal of the sensor network in [1] 
was that each sensor reconstructs the data measured by all 
of the sensors using sensor broadcasting. In this paper, we 
focus on the case where the reconstruction is required only 
at the collector node. Also, in this paper, the task is not 
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the reconstruction of the data the sensors measured, but the 
reconstruction of the underlying random process. 

Gastpar and Vetterli [2] studied the case where the sensors 
observe a noisy version of a linear combination of L Gaussian 
random variables which all have the same variance, code 
and transmit those observations to a collector node, and the 
collector node reconstructs the L random variables. In [2], 
the expected distortion achieved by applying separation-based 
approaches was shown to be exponentially worse than the 
lower bound on the minimum achievable expected distortion. 
In this paper, we study the case where the data of interest at the 
collector node is not a finite number of random variables, but 
a random process. We assume that the sensors are able to take 
noiseless samples. Our upper bound is also developed by using 
a separation-based approach, but it is shown to be of the same 
order as the lower bound, for a wide range of power constraints 
for random processes that satisfy some general conditions. 

El Gamal [3] studied the capacity of dense sensor networks 
and found that all spatially band-limited Gaussian processes 
can be estimated at the collector node, subject to any non-zero 
constraint on the mean squared distortion. In this paper, we 
study the minimum achievable expected distortion for space- 
limited, and thus, not band-limited, random processes, and 
we show that the minimum achievable expected distortion 
decreases to zero as the number of nodes increases, unless 
the sum power constraint is unusually small. 

In [4], we studied this problem when the underlying process 
was Gauss-Markov. We found the minimum achievable ex- 
pected distortion and the corresponding order-optimal achiev- 
ability scheme for a wide range of sum power constraints. In 
this work, we extend our results to the case where the un- 
derlying process is a Gaussian random process which satisfies 
some general conditions. We first provide lower and upper 
bounds for the minimum achievable expected distortion for 
arbitrary Gaussian random processes for which the Karhunen- 
Loeve expansion exists. Then, we focus on the case where 
the Gaussian random process also satisfies some general 
conditions, evaluate the lower and upper bounds explicitly, 
and show that they are of the same order, for a wide range 
of sum power constraints. Thus, for these random processes, 
under a wide range of sum power constraints, we determine an 
order-optimal achievability scheme, and identify the minimum 
achievable expected distortion. 



II. System Model 

The collector node wishes to reconstruct a sequence of 
random processes {S"'(t),0 < t < To}™ =1 , i.i.d. in time, 
where / denotes the time, n is the block length, and t 
denotes the spatial position. At each time instant, the random 
process S(t) is assumed to be Gaussian with zero-mean and 
a continuous autocorrelation function K(t,s). The N sensor 
nodes are placed at positions = t\ < t 2 < ■ ■ ■ < tj\r = To, 
and observe samples = (S(ti), S(t 2 ), ■ ■ ■ ,S(t]y)). For 
simplicity and to avoid irregular cases, we assume that the 
sensors are equally spaced. The distortion measure is the 
squared error, 

d(s(t),s(t)) = ^r [ °(s(t)-s(t)) 2 dt (1) 

^0 Jo 

Each sensor node and the collector node, denoted as node 
0, is equipped with one transmit and one receive antenna. At 
any time instant, let X; and Yi denote the signals transmitted 
by and received at, node i, and let hji denote the channel gain 
from node j to node i. Then, the received signal at node i can 
be written as, 

N 

Y t = hjiXj+Zi, 1 = 0,1,2,-.. ,N (2) 

where {Zi}fL Q is a vector of N+l independent and identically 
distributed, zero-mean, unit-variance Gaussian random vari- 
ables. Therefore, the channel model of the network is such that 
all nodes hear a linear combination of the signals transmitted 
by all other nodes at that time instant. We assume that the 
channel gain hij is bounded, i.e., 

hi<h tj <h u , i,j = 0, 1, ••• ,N (3) 

where h u and hi are positive constants independent of N. 
This model is quite general and should be satisfied easily: by 
the conservation of energy, /i?. < l,i,j = 0, 1, • • • ,N, and 
since all nodes are within finite distance from each other, the 
channel gains should be lower bounded as well. This channel 
gain model differs from the one in [4], and is more reasonable. 
Since the collector node is also equipped with a transmit 
antenna, there is feedback from the collector node to the sensor 
nodes. However, in a wireless environment, this feedback is 
imperfect, in the sense that it is corrupted by channel noise, 
as well as interference from other simultaneously transmitting 
nodes. 

We assume that K channel uses are allowed per realization 
of the random process in time for the reconstruction, where K 
is a finite positive integer independent of the number of sensors 
N and block length n. We also assume that all sensors share a 
sum power constraint of P(N) which is a function of N, The 
two most interesting cases for the sum power constraint are 
P{N) = NPmi where each sensor has its individual power 
constraint P\ n &, and P(N) = P tot where all sensors share a 
constant total power constraint P tot . Our goal is to determine 
the scheme that achieves the minimum achievable expected 
distortion D N at the collector node for a given total transmit 



power constraint P(N), and also to determine the rate at which 
this distortion goes to zero as a function of the number of 
sensor nodes and the power constraint. 

All logarithms are base e. Due to space limitations, all 
proofs are omitted here and can be found in [5], 

III. The Class of Gaussian Random Processes 

For a Gaussian random process S(t) with continuous auto- 
correlation, we perform the Karhunen-Loeve expansion 

oo 

S(t) = J2Sk<t>k(t) (4) 

fc=0 

to obtain the ordered eigenvalues {Afe}^L , and corresponding 
eigenfunctions {(f> k (t),t G [0,T ]}^ . 

Let A be the set of Gaussian random processes that satisfy 
the following conditions: 

1. There exist nonnegative constants di, d u and nonnegative 
integers cj, c u and Kq > c u + 1 such that when k > Kq, 

for some constant x > 1. The condition that x > 1 is without 
loss of generality, because for all continuous autocorrelations, 
the eigenvalues decrease faster than fc _1 . 

2. In addition to continuity, K(t, s) satisfies the Lipschitz 
condition of order 1/2 < a < 1, i.e., there exists a constant 
B such that 

\K(t 1 ,si)-K(t 2 ,s 2 )\ < B (y % - t 2 ) 2 + (si - S2) 2 Y 

(6) 

for all t 1 ,s 1 ,t 2 ,s 2 G [0,T ]. 

3. For k = 0, 1, • • ■ , the function <j>\{s) and the function 
K (t, s)4>k(s) as a function of s satisfy the following condition: 
there exist positive constants B\, B 2 , B%, B4, /3 < 1, 7 < 1, 
and nonnegative constant r, independent of k such that 

" 0fc(«a)l < Mk + S 4 ) T |si - S2 | 7 (7) 
and for all t £ [0, T ] 

\K{t, Sl )4> k { Sl ) - K(t,s 2 )<t> k (s 2 )\ < B 2 {k + Bi) r |si - s 2 f 

(8) 

for all si, s 2 G [0,T ]. 

The reasons why these conditions are needed for explicit 
evaluation of the lower and upper bounds on the minimum 
achievable expected distortion will be clear from the proofs, 
which are not presented here due to space limitations. We 
provide some intuition as to why these conditions are needed. 
Condition 1 shows that we consider random processes that 
have eigenvalues which decrease at a rate of approximately 
k~ x . The lower (upper) bound on the eigenvalues in l|5} will 
be used to calculate the lower (upper) bound on the minimum 
achievable expected distortion. Conditions 2 and 3 are needed 
because instead of the random process itself that is of interest 
to the collector node, the collector node, at best, can know 
only the sampled values of the random process. How well 



the entire process can be approximated from its samples is 
critical in obtaining quantitative results. Lipschitz conditions 
describe the quality of this approximation well. For instance, 
by condition 3, we require the variation in the eigenfunctions 
0| to be no faster than order k T . We note that the well-known 
trigonometric basis satisfies this condition. We also note that 
our conditions are quite general. Many random processes 
satisfy these conditions including the Gauss-Markov process, 
Brownian motion process, etc. 

IV. A Lower Bound on the Minimum Achievable 
Expected Distortion 

A. Arbitrary Gaussian Random Processes 

The lower bound is obtained by assuming that all of the 
sensor nodes know the random process exactly, and, the sensor 
network forms an A-transmit 1 -receive antenna point-to-point 
system to transmit the random process to the collector node. 
Let be the capacity of this point-to-point system and 
D p (R) be the distortion-rate function of the random process 
S(t) [6]. In this point-to-point system, the separation principle 
holds and feedback, imperfect or perfect, does not increase the 
capacity, and therefore 



D">D P (CZ) 



(9) 



To evaluate D P (C*), we first find the rate distortion function, 
which is the inverse function of D p (R), of S(t) [6, Section 
4.5] as, 



fl(0)=5>ax(o,ilog(^ 

k=0 



and 



D{6)=T - 1 J2mm(6,\ k ) 



(10) 



(11) 



fc=0 



It can be seen that the function R(9) is a strictly decreasing 
function of 9 when 9 < Xq. Hence, in this region, the inverse 
function of R(9) exists, which we will call 9(R), R>0. Next, 
we find C£ , the capacity of the A-transmit 1 -receive antenna 
point-to-point system [7] over K channel uses as, 



C» = §log(l + P(N)f2h%) 



Then, we have 



D p (C?)=D(0(CZ)) 



N \ 



(12) 



(13) 



Thus, for arbitrary Gaussian random processes, a lower bound 
on the minimum achievable expected distortion is 



D»=D P {C:) 



(14) 



B. The Class of Gaussian Random Processes in A 

Next, we evaluate D p (C^ ) for the class of Gaussian random 
processes in A. We will divide our discussion into two separate 
cases based on the sum power constraint. For the first case, 
P(N) is such that 



JV 



lim (NP(N)y 1 = 



(15) 



is satisfied. The cases where P(N) — APj n d and P(N) = P t ot 
are included in P(N) satisfying (1 151 . Note that increases 
monotonically in A. Since we are interested in the number 
9(C^), we will analyze the function 9(R) where R is very 
large. Correspondingly, this means that we will analyze the 
function D(9) where 9 is very small. 

Lemma 1 For large enough R, we have 

9(R)>di(^y R- x (16) 

Lemma 2 For small enough 0, we have 

i 

D{9) > (17) 

We are now ready to calculate the distortion. When A is 
large enough and the sum power constraint P(N) satisfies 
(TBI , using <fl7i . fl6l and the fact that 



Cf <f log(l + ^ATP(iV)) 



(18) 



a lower bound on the achievable distortion is 

6 ((log(AF(A))) 1 - a; ) (19) 

For the second case, P(N) is such that (II 51 is not satisfied, 
is either a constant independent of A or goes to zero 
as A goes to infinity. Examining ( II PL we see that 9(C^) 
is bounded below by a constant independent of A, and 
hence, D (6 (C^)) is a constant and does not go to zero as 
A increases. Therefore, combining this case with dl9l >. for 
all possible power constraints P(N), a lower bound on the 
distortion is 



fmin ( (log(AF(A))) 1_ 



1 



(20) 



When the sum power constraint grows almost exponentially 
with the number of nodes, the lower bound on the minimum 
achievable expected distortion decreases inverse polynomially 
with N. Even though this provides excellent performance, it is 
impractical since sensor nodes are low energy devices and it 
is often difficult, if not impossible, to replenish their batteries. 

When the sum power constraint is such that dl5> is not satis- 
fied, the transmission power is so low that the communication 
channels between the sensors and the collector node are as if 
they do not exist. The estimation error is on the order of 1, 
which is equivalent to the collector node blindly estimating 
S(t) = for all t 6 [0,Tq]. Even though the consumed 
power P(N) is very low in this case, the performance of the 
sensor network is unacceptable; even the lower bound on the 



minimum achievable expected distortion does not decrease to 
zero with the increasing number of nodes. 

For practically meaningful sum power constraints, including 
the cases of P(N) = iVP ind and P(N) = P toU the lower 
bound on the minimum achievable expected distortion decays 
to zero at the rate of 

(logiV) 1 -* (21) 

V. An Upper Bound on the Minimum Achievable 
Expected Distortion 

A. Arbitrary Gaussian Random Processes 

Any distortion found by using any achievability scheme 
will serve as an upper bound on the minimum achievable 
expected distortion. We consider the following separation- 
based achievable scheme: First, we perform distributed rate- 
distortion coding at all sensor nodes using [8, Theorem 
1]. After obtaining the indices of the rate-distortion codes, 
we transmit the indices as independent messages using the 
amplify-and-forward method introduced in [9]. The distortion 
obtained using this scheme will be denoted as ■ 

We apply [8, Theorem 1], generalized to N sensor nodes in 
[10, Theorem 1], to obtain an achievable rate-distortion point. 



Theorem 1 If the individual rates are equal, the following 
sum rate and distortion are achievable, 

D»(6>) 

= k C { K{t > t] wh p » {t) { ^' n + e ' iyl PN[t) ) dt 



N-l 



<(0') = £^iog i 



(TV)" 



(22) 
(23) 



fe=0 



where pjv(t) is an N x 1 column vector with the 
i-th entry being K (f, [i — 1)/(N — 1)Tq). T.' N is 
an N x N matrix with the (i,j)-th entry being 
T /(N - 1} K ((i - 1)/(N - 1)T , (j - 1)/(N - 1)T ), and 
/Mq , Hi , • • • , /4v-i are tne eigenvalues of H' N . 



We further evaluate D 



in the next lemma. 



Lemma 3 For all Gaussian random processes, we have 



O 



(24) 



where and are defined as 

n N-l „ i Tn / / • 1 

T ^ 



1 " JV^T-'O 



PN 



N-l 



n - p N {t) dt 



T, 



N-l J N-l' 



and 



(25) 



B (N) = - 



2 ^ 



Pn 



i - 1 

N-l 



To - p N {t) 



dt 

(26) 



respectively. 



Lemma [5] tells us that the expected distortion achieved by 
using the separation-based scheme is upper bounded by the 
maximum of three types of distortion. We define the third 
distortion as 



N-l 




(27) 



Now, we determine an achievable rate for the communica- 
tion channel from the sensor nodes to the collector node. The 
channel in its nature is a multiple access channel with potential 
cooperation between the transmitters and imperfect feedback 
from the collector node. The capacity region for this channel 
is not known. We get an achievable sum rate, with identical 
individual rates, for this channel by using the idea presented 
in [9]. This result is a generalization of [3, Theorem 1] from a 
constant power constraint to a more general power constraint. 



Theorem 2 When the sum power constraint P(N) is such 
that there exists an e > where 



lim P(N)N?- e > 1 



(28) 



the following sum rate is achievable over K channel uses, 

■\og(NP(N)) (29) 



c n = doK 



where do is a positive constant, independent of N. Otherwise, 
C^ 1 approaches a positive constant or zero as N — > oo. 

Theorem [2] shows that when the sum power constraint is such 
that J28i is satisfied, the achievable rate increases with TV. 
Otherwise, the achievable rate is either a positive constant 
or decreases to zero, which will result in poor estimation 
performance at the collector node. 

The function R% (9 r ) is a strictly decreasing function of 
6', thus, the inverse function exists, which we will denote as 
9%{R). Hence, to find , we first find 6* (Cf ), and then, 



D 



N 



(30) 



We will perform this calculation when the underlying random 
process is in A. 

B. The Class of Gaussian Random Processes in A 

We analyze all three types of distortion for Gaussian random 
processes in A. 



Lemma 4 For Gaussian random processes in A, we have 

A^=0(N- a ) (31) 
pW =o(N^- a \ (32) 



The results in Lemma |4] depend crucially on condition 2 in 
the definition of A in Section ITTT1 

Using the results of Lemma 0] we have 



D* = 0( max 



Ni-^D? (^(Cf)))) (33) 



It remains to evaluate (0^ (C^j). We first define two 



sequences i?^ and flit which satisfy 



L a " u "U 

1™ , 7 x . 



-1 ' X+T 



0, Jim ^ = (34) 



JV- 



Lemma 5 For large enough N and R in the interval of 



we have 



x x d, 



- < 6*{R) < 



2 x x 2x d„ 



gx R x - ^ y~, - ^ _ ^ xRx 

Hence, for all P(N) that satisfy 

7VP(/V) 



lim • 

N—>oo 











(35) 



(36) 



(37) 



and (28), we have in the interval of (1351 and Lemma [5] 
applies. 



Now we upper bound D? tli ' 1 



Lemma 6 For 6' G [i?^ , ] /or forge enough N, we may 

,N 
b 

ids ( x + r 



upper bound Dj?(0') as 



D 



N (nl 



)< 



Tn 



X - 1 



(38) 



Proofs of Lemmas [5] and [6] use all conditions 1, 2 and 3 in the 
definition of A in Section HTll 

Hence, when P(N) is such that (I37> and (12 8 1 are satisfied, 
using J38l > and (I36i and the fact that when i? is in the interval 
of l|f3, 0f (iJ) is in ,^], we have 



^(C(Ca ))<e (log(iVP(iV))) 



(39) 



From (I33> . an upper bound on the minimum achievable 
expected distortion is 

e ((io g (7VP(iv))) 1 - a; ) (40) 

when the sum power constraint satisfies (1281 and 



lim ■ 

N— >oo 



NP(N) 



,N 



2Q-1 /3 \ 
•2(x-l) 'ST^J 



= 



(41) 



This upper bound on the minimum achievable expected 
distortion coincides with the the lower bound when P(N) 



satisfies J28t > and Hli . The practically interesting cases of 
P{N) = NP iad and P(N) = P m fall into this region. In both 
of these cases, the minimum achievable expected distortion 
decreases to zero at the rate of 

(logiV) 1 -* (42) 

which is the same as the lower bound in (12 1 1 . 

VI. Conclusion 

We investigate the performance of dense sensor networks 
by studying the joint source-channel coding problem. We 
provide lower and upper bounds for the minimum achievable 
expected distortion when the underlying random process is 
Gaussian. When the random process satisfies some general 
conditions, we evaluate the lower and upper bounds explicitly, 
and show that they are both of order (log(7VP(iV))) 1_;r 
for a wide range of sum power constraints ranging from 

_j_ N^V' T >x=T< 3(*-l) >H$¥) 

N 2 to . Therefore, for random 

processes that satisfy these general conditions, and under these 
sum power constraints, we have found that an order-optimal 
scheme is a separation-based scheme, that is composed of 
distributed rate-distortion source coding [8] and amplify-and- 
forward channel coding [9], and the imperfect feedback link 
does not need to be utilized. 

The most interesting cases of P(N) = NP\ n d and P(N) — 
P to t fall into this region, and for these cases, the minimum 
achievable expected distortion decreases to zero at the rate of 
(logN) 1 ~ x . Hence, the power constraint P(N) = P tot per- 
forms as well as P(N) = NP^ "order-wise", and therefore, 
in practice we may prefer to choose P(N) = P tot . In fact, any 
P(N) > iV-Va+e ( f or example, P(N) = TV" 1 / 3 , performs 
as well as P(N) = NP ind and P(N) = P tot . This means 
that if we choose P{N) = N^ 1 ^ 3 , as we add more and 
more sensors, the sum power constraint can go to zero without 
affecting the performance "order-wise". 
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